Semi-supervised anomaly detection in dynamic communication networks
نویسندگان
چکیده
To ensure the security and stabilization of communication networks, anomaly detection is first line defense. However, their learning process suffers two major issues: (1) inadequate labels: there are many different kinds attacks but rare abnormal nodes in mt these atstacks; (2) inaccurate considering heavy network flows new emerging attacks, providing accurate labels for all very expensive. The label problem challenges existing methods because majority normal result a biased classifier while noisy will further degrade performance classifier. tackle issues, we propose SemiADC, Semi-supervised Anomaly Detection framework dynamic Communication networks. SemiADC approximately learns feature distribution with regularization from ones. It then cleans datasets extracts sasainaccurate by learned structure-based temporal correlations. These self-learning processes run iteratively mutual promotion, finally help increase accuracy detection. Experimental evaluations on real-world demonstrate effectiveness our which performs substantially better than state-of-art approaches without demand adequate supervision.
منابع مشابه
Unsupervised and Semi-supervised Anomaly Detection with LSTM Neural Networks
We investigate anomaly detection in an unsupervised framework and introduce Long Short Term Memory (LSTM) neural network based algorithms. In particular, given variable length data sequences, we first pass these sequences through our LSTM based structure and obtain fixed length sequences. We then find a decision function for our anomaly detectors based on the One Class Support Vector Machines (...
متن کاملFixed-Background EM Algorithm for Semi-Supervised Anomaly Detection
Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Tommi Vatanen, Mikael Kuusela, Eric Malmi, Tapani Raiko, Timo Aaltonen and Yoshikazu Nagai Name of the publication Fixed-Background EM Algorithm for Semi-Supervised Anomaly Detection Publisher School of Science Unit Department of Information and Computer Science Series Aalto University publication series SCIENCE + TECHNOLOGY 2...
متن کاملSemi-supervised Statistical Approach for Network Anomaly Detection
Intrusion Detection Systems (IDS) have become a very important defense measure against security threats. In recent years, computer networks are widely deployed for critical and complex systems, which make them more vulnerable to network attacks. In this paper, we propose a two-stage Semi-supervised Statistical approach for Anomaly Detection (SSAD). The first stage of SSAD aims to build a probab...
متن کاملAnomaly detection in dynamic networks: a survey
Anomaly detection is an important problem with multiple applications, and thus has been studied for decades in various research domains. In the past decade there has been a growing interest in anomaly detection in data represented as networks, or graphs, largely because of their robust expressiveness and their natural ability to represent complex relationships. Originally, techniques focused on...
متن کاملToward Supervised Anomaly Detection
Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails to match the required detection rates in many tasks and there exists a need for labeled data to guide the model generation. Our first contribution shows that...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information Sciences
سال: 2021
ISSN: ['0020-0255', '1872-6291']
DOI: https://doi.org/10.1016/j.ins.2021.04.056